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Abstract 

The iC-user cyclic Z-interference channel models a situation in which the A;th trans- 
mitter causes interference only to the {k — l)th receiver in a cyclic manner, i.e., the 
first transmitter causes interference only to the Kth receiver. The impact of noiseless 
O ■ feedback on the capacity of this channel is studied by focusing on the Gaussian cyclic 

Z-interference channel. To this end, the symmetric feedback capacity of the linear shift 
Q\ • deterministic cyclic Z-interference channel (LD-CZIC) is completely characterized for 

■ all interference regimes. Using insights from the linear deterministic channel model, 
the symmetric feedback capacity of the Gaussian cyclic Z-interference channel is char- 
acterized up to within a constant number of bits. As a byproduct of the constant 

^ ■ gap result, the symmetric degrees of freedom with feedback for the Gaussian cyclic 

■ Z-interference channel are also characterized. These results highlight that the sym- 
metric feedback capacities for both linear and Gaussian channel models are in general 
functions of K, the number of users. Furthermore, the capacity gain obtained due to 
feedback decreases as K increases. 



1 Introduction 

Managing the effects of interference is a key issue in currently deployed wireless networks. 
Among several ways to mitigate or perhaps constructively using interference is to make use 
of cooperation amongst interfering users. In this paper, we focus on one such important 
issue by studying the impact of noiseless receiver-to-transmitter feedback on the capacity 

*The research was supported in part by the Air Force Office of Scientific Research MURI Grant FA-9550- 
09- f -0643 and in part by the National Science Foundation Grant CNS-09-05398 
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of the K-user cyclic Z-interference channel (CZIC). In this model, K transmitters intend 
to transmit independent messages to K respective receivers and the kth transmitter causes 
interference to the {k — l)th receiver in a cyclic manner. The motivation for studying the 
cyclic Z-interference channel comes from the modified Wyner model [1] , which describes the 
soft handoff scenario of a cellular network. In the original Wyner model [2], each receiver 
can suffer interference from its adjacent transmitters. In the modified Wyner model, one 
can assume that the terminals are situated along a circular array (see Figure [1]). If in 
addition, we assume that the mobile communicates with the intended base-station on its left 
(or right), while suffering interference due to the BS to its right (or left), then the resulting 
channel model is the i^-user CZIC, which is considered in this paper. The K-nser Gaussian 
CZIC (G-CZIC) without feedback was recently investigated in [3j, where it was shown that 
the generalized degrees-of-freedom of the symmetric K-usei G-CZIC are the same as for 
the 2-user Gaussian interference channel. By an interesting generalization of the results of 
Etkin, Tse and Wang [4] , the approximate symmetric capacity was characterized for the weak 
interference regime and the exact capacity region was characterized for the strong interference 
regime. A simpler variation of the Gaussian i^'-user CZIC has been studied in [5], where the 
results of [3] are strengthened for the 3-user case. It is shown in [5] that a generalization of 
the Han-Kobayashi |6j scheme can achieve sum-capacity for some interference regimes. 

In this paper we focus on the i^-user CZIC with feedback, i.e., we assume the presence of 
noiseless and causal feedback from the kth receiver to the kth transmitter. For K = 2, this 
model reduces to the conventional 2-user interference channel with feedback. For K > 2, this 
model is a special case of the general K-nser interference channel with feedback (see Figure [2]). 
The 2-user interference channel with various forms of feedback has been investigated recently. 
Feedback coding schemes for i^'-user Gaussian interference networks have been developed by 
Kramer in [7]. Outer bounds for the 2-user interference channel with generalized feedback 
have been derived in [8] and [9] (also see references therein). The 2-user Gaussian interference 
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Figure 2: K-user cyclic Z- interference channel with feedback. 



channel with noiseless (channel output) feedback was considered in [10] and the feedback 
capacity region was characterized to within two bits. One of the main findings in [10] is 
that feedback provides multiplicative gain at high signal-to-noise ratio (SNR) and the gain 
becomes arbitrarily large for certain channel parameters. The key insights that led to this 
result were obtained by characterizing the feedback capacity region of the linear deterministic 
(LD) 2-user interference channel. The linear deterministic model despite its simplicity can 
provide valuable insights for the Gaussian channel model. 

With this correspondence at hand, we first focus on the linear deterministic K-nser CZIC 
with feedback. We characterize the symmetric feedback capacity, C^^.ld) which is defined 
as the maximum R such that the rate i^-tuple {R, R, . . . ,R) is achievable with feedback. 
We use insights from the linear deterministic model to characterize the symmetric feedback 
capacity of the K-user Gaussian CZIC within a constant number of bits (independent of the 
channel gains) for all interference regimes. As a consequence of our constant gap results, 
we also establish the generalized feedback degrees of freedom of the Gaussian CZIC. For the 
scope of this paper, we restrict our attention to the case of symmetric channel parameters. 
For instance, for the Gaussian CZIC with feedback, we assume that the direct channel gain 
from the kth transmitter to the kth receiver is same for all k, and that the interference 
channel gain from the kth transmitter to the {k — l)mod (i^)th receiver is the same for all 
k. 

The symmetric i^-user Gaussian CZIC is described by the pair (SNR, INR), where SNR 
denotes the direct channel gain and INR denotes the interference channel gain. The degrees 
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of freedom (DoF) of the Gaussian CZIC (per-user) without feedback is defined as 

DoF(a,ir) = l lim '^--■^W 



KSNR^ooilog(l + SNR)' ' ' 

where Csum,G{K) is the sum-capacity without feedback, and a is the interference parameter, 
defined as a = i'°|(-sn r') • Analogous to ([T]), we define the generahzed feedback degrees of 
freedom of the Gaussian CZIC (per-user) as 

where CJ^q{K) is the sum-capacity with feedback. 

In the breakthrough paper [4|, several novel results were obtained for 2-user Gaussian 
interference channel. Among one of the results, is the characterization of the DoF. In 
particular, it was shown that DoF(a;, 2) = min(max(l — a, a), 1 — a/2). On the other hand, 
the feedback DoF for K = 2 was recently characterized in [TU] and is given as DoF^^(a;, 2) = 
max(l — a/2, a/2). From the results of [3j, it is clear that the DoF without feedback for the 
K-user Gaussian CZIC is the same for all K >2, i.e., it is independent of K, the number of 
users. It is natural to ask the question that this equivalence continues to hold in presence of 
feedback for isT > 2 ? 

We answer this question in the negative by showing that the feedback DoF of the K- 
user Gaussian CZIC is in general a function of K. Of particular interest is the very strong 
interference regime, corresponding to a > 2. In this regime the feedback DoF for the 
2-user case is given as DoF^^(q;,2) = a/2. This implies that the feedback gain can be 
unbounded as a increases. For this regime, we show that the feedback DoF of the i^-user 
Gaussian CZIC is given as DoF™(a,if) = 1 + This result shows that for a fixed 

a, as the number of users increase, the feedback gain decreases and completely vanishes in 
the limit K oo. The outer bounds derived in this paper to establish capacity/constant 
bit gap results can be regarded as genie aided bounds derived for the 2-user case considered 
in [To]. However, as K, the number of users increases, selecting appropriate genies becomes 
prohibitively complex. In particular, for the i^'-user CZIC, we have a total of K\ sum-rate 
upper bounds. Depending on the interference parameter a, we carefully select the best upper 
bound among the K\ upper bounds. 

This paper is organized as follows. In Section [21 we describe the i^-user cyclic Z- 
interference channel with feedback. In Section |3] we describe our main results for both 
linear deterministic and Gaussian i^'-user CZICs. We provide the intuition as to why the 
feedback gain decreases as the number of users increases. Proofs for the K-user linear de- 
terministic CZIC are presented in Sections H] and |5l Constant gap results for the feedback 
capacity of the i^'-user Gaussian CZIC are established in Section [61 We conclude the paper 
in Section [71 
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2 K-user Cyclic Z-Interference Channel with Feedback 



The K-usei cyclic Z-interference channel is described by K conditional probabilities 
{p{yi\xi, X2) , p{y2\x2, X3), . . . ,p{yK\xK, xi)}. A (T, Mi, . . . , Mk) feedback code for the CZIC 
consists of sequences of K encoding functions 

h,t:{l,...,Mk}xyl-'^Xk,t, k^l,...,K, (3) 

for i = 1, . . . , T, and K decoding functions 

g,:y^^{l,...,M,}, k = l,...,K. (4) 

The probability of decoding error at decoder k is denoted by Pk and is defined as = 
F{gjs{Yi[) 7^ Wk), where Wk is the message of transmitter k. 

A rate i^-tuple {Ri,...,Rk) is achievable for the i^-user CZIC if there exists a 
{T, Ml, . . . , Mk) feedback code such that log(Mfc)/T < Rk — ek,T and Pk < ek,T, where 
^k,T — >■ as T — )■ 00 for all k. The feedback capacity region C^^{K) is the set of all achiev- 
able X-tuples. 

In this paper, we focus on the symmetric feedback capacity of the K-user CZIC, denoted 
by Cf^{K), which is defined as the maximum R such that {R, . . . ,R) e C^^{K). 

2.1 Linear deterministic CZIC with Feedback 

The symmetric linear deterministic CZIC is described by a pair of integers (n,m), where n 
denotes the number of signal (direct) levels and m denotes the number of interference levels 
observed at the receivers. 

The channel input of transmitter k, denoted by X^, for k = 1, . . . , K, is assumed to be 
of length max(n, m). 

When n > m, we denote 

Uk : top-most (n — m) bits of Xk 

Vk : top-most m bits of Xk (5) 
Lfe : lower- most m bits of Xk- 

With this notation, we can write the channel outputs for the K-user LD-CZIC as follows: 

Yk^{Uk,Lk®Vk+i), (6) 

ior k^l,...,K. 
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When n < m, we denote 



Uk '■ top-most (m — n) bits of 

Vk : top-most n bits of Xk (7) 
Lk : lower-most n bits of Xk- 

With this notation, we can write the channel outputs for the i^-user LD-CZIC as follows: 

Yk = {Uk+i,Lk+i®Vk), (8) 

for k = 1, . . . , K, where we define 

Vk+i = Vi, Uk+i = Ui, Lk+i=L, (9) 

for consistency. 

For instance, when n > m, the 3-user LD-CZIC is described by the following input-output 
relationships: 

Y, = {UuL,(BV2) 
Y2 = {U2,L2(BVs) 
Y3 = {U,,L;(BV,). 



2.2 Gaussian i^-user CZIC with Feedback 

To describe the i^'-user Gaussian CZIC, we denot^ the signal transmitted by user k as X^. 
We impose an average unit power constraint at each user; that is Ef^^] < 1. The signal 
observed at receiver k is obtained by 

Yk = VsmXk + VmRXk+i + Zk, k = i,2,...,K, (lo) 

where we define Xk+i — Xi for consistency, and the noise Zk at receiver k is zero mean 
Gaussian random variable with unit variance. Moreover, the noises across the receivers are 
assumed to be independent, i.e., and Z^' are independent for k k' . 



3 Main Results 

The results for the linear deterministic model are presented in terms of the interference 
parameter a, which is defined in this model as the ratio of the number of interference levels 

"'^With slight abuse of notation, we use similar notation for both LD-CZIC and G-CZIC channel models. 
However, the corresponding notation should be clear from the context. 
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to the number of signal levels, i.e., 



a = — . (Ill 
n 



m 



We define the normalizecl^ symmetric feedback capacity per-user of the LD-CZIC as follows: 

^ym,LDl«,^) = T7 Z , (1^) 



where C^mLol-^) the feedback sum-capacity of the i^-user LD-CZIC. 
We present our first result in the following theorem: 



Theorem 1 The normalized symmetric feedback capacity, Cf^i^j^{a, K) of the K-user LD- 
CZIC is given as 



(^sym,LD(">^) = ' 



(l-a) + f, 0<a<l/2 
a + l/2<a<2/3 
1 - f , 2/3 < a < 1 (13) 

f, l<a<2 
.1 + ^, «>2, 

Theorem [1] is proved in two parts: feedback coding schemes are presented in Section H] and 
corresponding upper bounds for the normalized symmetric feedback capacity are obtained 
in Section [5l 

The constant bit gap results for the Gaussian model are presented in terms of two pa- 
rameters (CsNR, C||\ir), defined as: 

CsNR = ^log(l + SNR) (14) 
aNR = ^log(l + INR). (15) 

We also define the interference parameter for the Gaussian model as 

We define the symmetric feedback capacity per-user of the iiT-user Gaussian CZIC as 
follows: 



^7111,01^) = ^ ) (1') 



^normalized with respect to the number of direct levels, 
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where g(-^) feedback sum-capacity of the .ft'-user Gaussian CZIC. We next define 

the feedback degrees of freedom per-user for the if-user Gaussian CZIC as follows: 



DoF™(a,ir)= lim 



SNR^oo ilog(l + SNR) ' ' 

We present our next result in the following theorem: 

Theorem 2 The symmetric feedback capacity per user, Cf-^Q{K) of the K-user Gaussian 
CZIC satisfies 

'CsNR-C,NR + %^, 0<a<l/2 
g|NR+ (^^snr-3Ci,r) ^ l/2<a<2/3 



C|NR 
2 ■ 



2/3 < a < 1 
1 < a < 2 



(19) 



'^SNR H ^ , a ^ ^, 



where the notation A ^ B implies that {A — B) < 3, i.e., the worst case gap (for all 
interference regimes) between the upper and lower bounds is at most 3 bits/user. 

Theorem [2] is proved in Section [6l where we use key insights from the linear deterministic 
model to construct feedback coding schemes and corresponding upper bounds on the feedback 
sum capacity. Further analysis of these bounds shows that they differ by a constant number 
of bits, which is independent of (SNR, INR). We note here that the worst case gap of 3 can 
be reduced depending on the interference regime. For instance, in our proof of Theorem 121 
we show that the gap for the case when a > 2 is at most 2 bits. 
As a consequence of Theorem [21 we have the following corollary: 

Corollary 1 The feedback degrees of freedom per-user of the K-user Caussian CZIC is given 
as 



l-a) + §, 0<a<l/2; 



a + 



(2-3a) 



K ' 



DoF^^(a,K) = <^ 



1 - - 

2 ' 



2 ' 



1 + 



("-2) 
K ' 



1/2 < a < 2/3; 
2/3 < a < 1; 
1 < a < 2; 
a>2. 



(20) 
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We recall the no-feedback degrees of freedom per-user of the i^-user Gaussian CZIC [3]: 



0<a<l/2 
a, l/2<a<2/3 

1 - f , 2/3 < a < 1 (21) 
f, l<a<2 
1, 2<a. 



Note that BoF{a,K) is independent of i^', i.e. DoF(a, Z^) = DoF(a,2), for all K. This 
implies that from the DoF point of view, the behavior of the i^-user system is similar to 
the K = 2 user system in the absence of feedback. 

On the other hand, we note that the feedback DoF for = 2 is given as (TU] 

DoF™(a,2)=<; 2' ^22) 
f, a>l. 

In the light of above observations, it is natural to ask whether the behavior of the i^-user 
Gaussian CZIC mimics the behavior of the K = 2 system in the presence of feedback. 
Corollary [T] answers this question in the negative by showing that the feedback DoF per- 
user for i^' > 2 is in general a function of K. Moreover, the feedback DoF of i^' = 2 always 
serves as an upper bound for the feedback DoF for K > 2 users. 

In Figure 131 the feedback DoFs are shown for the i^-user Gaussian CZIC, when K = 2,4 
and 10. 

Remark 1 Corollary{l\ also shows that DoF^^{a, K) can be strictly less than DoF™(a,2) 
(see Figure\3\). Secondly, it also shows that T)oF^^{a, K) is monotonically decreasing in K. 
Hence, as the number of users in the system increase, the DoF gain obtained via feedback 
decreases. Furthermore, in the limit K — t- oo, the feedback gain vanishes, i.e., we have 

lim DoF™(a, K) = DoF(a, K). (23) 

K^oo 

4 Feedback Coding Schemes for LD-CZIC 
4.1 Very- weak interference: < a < 1/2 

In this regime, we show that K{n — m) +m bits per user can be reliably sent in K channel 
uses. 

As an example, we start with the case in which K = 4 and m = 1, n = 3, so that a = 1/3. 
To achieve 9 bits per user in 4 channel uses, the following coding scheme is used (see Figure 
H: 
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1.3 




DoF(a,K) 

DoF''^(a,2) 

DoF'^^(a,4) 



K=4 



K=2 



* 



* 



2/3 



5/8 



1/2 



No feedback 







1/2 



2/3 



2 



2.5 



a = 



log(INR) 
log(SiVJ?) 



Figure 3: Feedback DoF of the i^T-user Gaussian CZIC. 



• In the first channel use, each encoder transmits fresh bits on all levels (for example, 
encoder 1 sends 01,02,03). 

• Upon receiving feedback, each encoder can decode the upper most bit of the next 
encoder (encoder 1 decodes bi, encoder 2 decodes ci, etc.). 

• In all subsequent channel uses, each encoder transmits the previously decoded bit on 
the top most level and fresh information bits in the remaining lower two levels (at t = 2 
encoder 1 transmits bi on the top level and 04, 05 on the two lower levels). 

• From Figure H] it is clear that each user can reliably transmit 9 bits to its decoder in 4 
channel uses. Hence, this scheme yields a normalized symmetric rate of (9/4) * (1/3) = 



This scheme can be readily generalized for arbitrary numbers of users K and for any 
a G [0,1/2] as follows: at t = 1, every encoder transmits n fresh information bits. Using 
feedback, the kth encoder decodes the lower most m bits transmitted by the {k + l)th 
encoder. For all subsequent 1 < t < K, the kth encoder transmits the previously decoded 
m bits on the top most m levels and transmits fresh information in the lower {n — m) levels. 
This scheme achieves K{n — m)+m bits per user in K channel uses and the achievable rate 
is {n — m) + m/K. Hence for a G [0, 1/2], we have 



3/4. 




(24) 
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Figure 4: Feedback Coding scheme for a = 1/3, = 4. 



4.2 Weak interference: 1/2 < a < 2/3 

For this regime, we present a feedback coding scheme that achieves Km + {2n — 3m) bits per 
user in K channel uses. We break the channel input of encoder k into four mutually exclusive 
sets of levels as follows: X^it) = {Xk^i{t), Xi:^2(t), X^^sit), Xk^iit)), where the number of bits 
in Xk,r{t) are (2m — n), {2n — 3m), (2m — n) and {n — m), for r = 1, 2, 3 and 4, respectively. 

At if: = 1, each encoder transmits fresh information bits on Xfc^i(l), Xfc^2(l) and Xfc^4(l) 
levels. For all t G {1, . . . , K}, all encoders remains silent in the X/^ 3(t) level. At t, due to 
feedback, encoder k can decode the bits transmitted by the encoder {k + 1) in the second 
subset level, i.e., it can decode X(fc+i) 2(t). For aAl 1 < t < K, encoder k transmits 

Xk{t) = (Xfc,i(t),X(fc+i),2(t- l),0,Xfc,4(t)), 

where Xk^i{t) and Xk^A{t) consist of fresh information bits. It is clear that Km bits are 
achievable from the levels 1 and 4. A gain of {2n — 3m) bits is provided by feedback in K 
usages of the channel. It can be easily verified that this coding scheme yields Km + {2n~3m) 
bits per user in K channel uses. Hence, we have 

Cm,LD(«,^)>«+^^^. (25) 
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4.3 Moderate-strong interference: 2/3 < a < 2 

In this regime, Theorem [T] shows that feedback does not increase the normahzed symmetric 
capacity and hence the no-feedback coding scheme in p] suffices. 

4.4 Very- strong interference: a > 2 

In this regime, we will show that {K — 2)n + m bits per user are achievable in K channel 
uses. 

As an example, we start with the case in which K = 4 and m = 3 and = 1, so that 
a = 3. To achieve 5 bits per user in 4 channel uses, the following coding scheme is used (see 
Figure |5]) : 

• In all channel uses, each encoder remains silent in the lower most bit. In the first 
channel use, each encoder transmits 2 fresh bits (for instance, encoder 1 sends 01,02 
and encoder 2 sends 6i,&2)- Using feedback, each encoder can decode the second bit 
transmitted by the encoder interfering its decoder (encoder 1 decodes 62, encoder 2 
decodes C2 etc.). 

• In all subsequent channel uses, each encoder transmits a fresh information bit in the 
top-most level and the previously decoded bit in the second level (for instance, at t = 2, 
encoder 2 sends the fresh bit 63 in the top-most level and the decoded bit C2 in the 
second level). 

• From Figure [5l it is clear that in 4 channel uses, using the top most level, each decoder 
receives 4 bits. One more bit is received from the interfering user in the final channel 
use (for instance, the bit 02 is received at decoder 1 in a delayed manner). This scheme 
yields a rate of 5/4 per user. 

This scheme can be readily generalized for arbitrary numbers of users K and for any 
a > 2 as follows: for any 1 < t < i^, all encoders do not transmit any information in the 
lower most n levels. At t = 1, the kth encoder transmits (m — n) fresh information bits 
in the top (m — n) levels. Using feedback, it decodes the (m — n) bits transmitted by the 
{k + l)th encoder. For any 1 < t < K, the kth encoder transmits fresh information on the 
top most n levels and in the remaining (m — 2n) levels, it transmits the lower (m — 2n) bits 
decoded at {t — 1). This scheme achieves Kn + (m — 2n) bits per user in K channel uses. 
Hence for a > 2, we have 

Cm,LD(«,i^)>l + ^^- (26) 

Theorem [1] shows that the feedback coding scheme presented above is optimal. Therefore, it 
is clear that the gain obtained via feedback should decrease as the number of users increases. 
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t 



K = 4 a = 3 




To substantiate this claim, we note that when a >2 (corresponding to m > 2n), a normahzed 
per-user rate of 1 can always be achieved without feedback by remaining silent on the lower 
most (m — n) levels and sending fresh information in the top-most n levels. However, with 
feedback, each user can send additional information in the middle (m — 2n) levels in the first 
channel use. This additional information can eventually reach the intended decoder via the 
delayed feedback path in K channel uses. For instance, in Figure |5l the bit 02 is eventually 
received at decoder 1 in the last channel use. Therefore feedback can boost the per-user 
rate from Kn bits to Kn + {m — 2n) bits in K uses of the channel. Therefore, the rate gain 
obtained via feedback is (m — 2n) / K which decreases as K increases. 



5 Upper bounds on the Feedback Sum-Capacity 

In this section, we present two types of upper bounds on the sum-capacity of the i^-user 
LD-CZIC. The type-I upper bound allows us to show that the normalized symmetric feed- 
back capacity for the i^-user LD-CZIC is always upper bounded by the symmetric feedback 
capacity of the 2-user system. The type-II upper bound is in fact a set of K\ genie-aided 
upper bounds, in which each upper bound corresponds to a permutation of K users. These 
type-II upper bounds are in fact valid for the general i^'-user interference channel with noise- 
less channel output feedback, i.e., they are not specifically derived for the cyclic interference 
channel. 

We present the type-I upper bound in the following theorem: 
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Theorem 3 The normalized symmetric feedback capacity of the K-user LD-CZIC satisfies 

Cm,LD(«,^)<max(l-|,|). (27) 

The proof of Theorem [3] is given in the appendix. The main idea behind this upper bound 
is to show that 

Rj + R{j+i) < max(2n — m,m), (28) 

for j = 1, . . . ,K. By adding all such K upper bounds and normalizing by 2nK, we obtain 
the desired bound stated in Theorem O Theorem [3] along with (pTi) leads to the conclusion 
that feedback does not increase the symmetric capacity of the i^-user LD-CZIC in the regime 
a G [2/3,2]. We next present the type-II upper bound: 

Theorem 4 Fix a permutation order vr = {tti, . . . , ttx}, then the feedback sum-capacity of 
the general K-user interference channel is upper bounded as follows: 

K 

< max V H{Y^^\X^„Y^„ F.,„ J - H{Yi, . . . ,Yk\Xu . . . , Xk). 

p{xi,...,xk) 7— • 
k=l 

To illustrate by an example, consider the case when K = 3, for which Theorem H] yields 6 
upper bounds on the feedback sum capacity: 



max 

p{xi,X2,X3) 


HiY,) 


+ H{Y2 


Xi 


Yi) 


+ HiY3 


Xi 


X2, 


Yu 


Y2) 


-HiY,,Y2, 


Y^ 


Xi 


X2 


X3) 


max 

p{xi,X2,X3) 


'h{Yi) 


+ H{Y, 


Xi 


Yi) 


+ H{Y2 


Xi 


X3, 


Yi^ 


Ys) 


-H{Y,,Y2, 


Y^ 


Xi, X2, Xs) 


max 

p{xi,X2,X3) 


'HiY,) 


+ H{Y^ 


X2 


Y2) 


+ H{Ys 




X2, 


Yi,Y2) 


-H{Y,,Y2, 


Y^ 


Xi 


X2 


X3) 


max 

p(xi,X2,X3) 


'h{Y2) 


+ H{Ys 


X2 


Y2) 


+ H{Y, 


X2 


X3, 


Y2, 


Ys) 


-H{Y,,Y2, 


Y^ 


Xi 


X2 


X3) 


max 

p{xi,X2,X3) 


'HiYs) 


+ H{Yi 


X3 


Ys) 


+ H{Y2 


Xi 


X3, 


Yi. 


Y3) 


-H{YuY2, 


Y, 


Xi 


X2 


X3) 


max 


'h{y,) 


+ H{Y2 


X3 


Y3) 


+ H{Y^ 


X2 


X3, 


Y2. 


Y3) 


-H{Y,,Y2, 


Y-, 


Xi 


X2 


X3) 



p{xi,X2,X3) . 



For an arbitrary K, Theorem H] gives a total of K\ upper bounds. Optimization of these 
bounds for the general K user case and asymmetric channel gains is prohibitively complex. 
For the scope of this paper, we are interested in the case of CZIC with symmetric channel 
parameters. Depending on the range of the interference parameter a, we carefully select 
one of the type-II bounds and evaluate it to obtain the desired converse result as stated in 
Theorem [TJ 
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5.1 Very Weak and Weak interference regimes: < a < 2/3 

In this regime, we select the type-II upper bound corresponding to the identical permutation 
order: 

7r = (l,2,...,ir). (29) 
Theorem S] yields the following upper bound on the sum-capacity: 

K 

Cm,LDW< max y^H{Y,\X,,Y,,...,X,_,,Y,_,)-H{Y,,...,YK\X,,...,XK) (30) 

p(xi,...,xk) 7 — ' 
fe=l 

K 

= max V/J(n|Xi,ri,...,Xfc_i,n_i) (31) 
= max H{Y,) + H{Y2\X,,Y,) + ... + H{Yk\X,,Y,,...,Xk^,,Yk-i) (32) 

p{xi,...,xk) 

K-1 



<n+ max ^2 H(Yk\Xk-i,Yk-i) + max H{Yk\Xi,Yi, Xk^i,Yk-i), 

p(xi,...,xk) , — ■ p(xi,...,xk) 

(33) 



where flHT]) follows from the fact that (Yi, . . . , Yx) are all deterministic functions of (Xi, . . . , Xk), 
and ( 133|) follows from the fact that H(Yi) < max(m, n) = n. 

To further upper bound ( 133|1 . we first recall the notation used for n > m in (|5]): 



Vk 
Lk 



top-most (n — m) bits of 
top-most m bits of X^ 
lower-most m bits of X^- 



For any 2 < k < {K — 1), we have the following sequence of inequalities: 

i7(n|X,_i, Yk-i) = H{Yk\Xk-i, Yk-i, Vk) (34) 

= HiUk, Lk © %+i) \Xk-i, n-i, ^fc) (35) 

</7(f/fc|Ffc) + if(Lfe©yfc+i) (36) 

< max (0, n — 2m) -|- m, (37) 

where flM|) is due to the fact that Vk can be determined from {Xk^i,Yk-i). 
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Finally we upper bound the last term in (133|) as follows: 

H(Yk\Xi,Yi, Xk-i,Yk-i) = H{Yk\Vi, Xi,Yi, Xk-i,Yk-i,Vk) (38) 

= H{Uk, Lk(BVi\Vu Vk, Xi, Fi, Xk-i, Yk-i) (39) 

<H{Uk,Lk\Vk) (40) 

= H{Xk\Vk) (41) 

<(n-m). (42) 

Using (l37j) and (H2l) . we can further upper bound ( l33ll to obtain 



Cfnm ld(^) < + (ir - 2) max (0, n - 2m) + m 



+ (n — m) 



(43) 



Therefore, the normalized symmetric feedback capacity is upper bounded as follows: 

/ minfa, 2 — 3a) 

^ym,LD(«, ^) < max(a, 1 - a) + — 

which can also be written as 



K 



(44) 



, :i - a) + f , < a < 1/2 
a + ^^^, l/2<a<2/3. 



(45) 



Note that the upper bound alone shows that in the limit K oo the upper bound 
converges to the no-feedback symmetric capacity. This implies that in the limit of large K, 
the feedback gain vanishes. 

5.2 Very strong interference: a > 2 

In this regime, we select the type-II upper bound corresponding to the following permutation 
order: 



7r={l,K,K-l,K-2,...,3,2). 
Theorem H] yields the following upper bound on the sum-capacity: 

C!Zld{K) < max \h{Yi) + H{Yk\X,,Y,) + H{Yk-i\Xu Xk,Y,,Yk) 

p(xi,...,xk) l 

+ H{Y2\Xi, X^, . . . , Xk, Yi, Is, . . . , Y^) 



< max 

p(xi,...,xk) 



H{Y,) + H{Yk\X,,Y,) + ^ H{Yk\Xk+u ^+0 



fc=3 



+ H{Y2\X,,Y,,X,,Y,] 



(46) 



(47) 



(48) 
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To further upper bound (HHj) . we recall the notation used for n < m in ([7]): 



Uk '■ top-most (m — n) bits of 
Vk : top-most n bits of Xk 
Lk : lower- most n bits of Xk- 

We now upper bound the terms in ( l48l) as follows. We first have the trivial upper bound 
H{Yi) < max(m,n) = m. We then bound the second term in ( HHl) as follows: 

H{Yk\Xi, Yi) = H{Ui, Li © Vk|Xi, Fi) (49) 

= H{L^(BVk\X^,Y^) (50) 

< n. (51) 

Next, for any 3 < A; < {K — 1), we have 

H(Yk\Xk+i, Ffc+i) = H{Uk+i, Lk+i © Vfe|Xfc+i, Ifc+i) (52) 
= /7(L,+i©yfc|Xfc+i,n+i) (53) 
< n, (54) 

which implies that 

K-l 

H{Yk\Xk+i, Yk+i) <{K- 3)n. (55) 

fc=3 

Finally, we have 

i/(F2|Xi, n, X3, Fa) = i^(t/3, ^3 © V^2|Xi, Fi, X3, Fs) (56) 
= i/(\/2|Xi,ri,X3,r3) (57) 

= /f(V2|t/2,Xi,y2,X3,y3) (58) 

= 0, (59) 

where (l59l) follows from the fact that a>2 corresponds to the case in which m — n > n and 
therefore V2 is completely determined by 1/2- 

Using (EH), (l55ll and (l59l) . we have the following upper bound from (HHll : 

Cs™,ldW < i/(ri) + /j(rx|Xi,ri) + ^/7(n|Xfc+i,n+i) + ^(>^2|Xi,ri,X3,r3) (60) 

fc=3 

<m + (i^-2)n. (61) 
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Normalizing this upper bound by nK^ we obtain 



>FB 

■sym,LD 



nK 

m + (A' — 2)n 



(62) 



(63) 



riK 




(64) 



which is the desired upper bound on the normahzed symmetric feedback capacity. 

6 Gaussian K-user CZIC with Feedback 

In this section, we consider the K-user Gaussian CZIC with feedback. The signal transmitted 
by user k is denoted by Xk- We impose an average unit power constraint at each user; that 
is E[X^] < 1. The signal observed at receiver k is obtained by 



where we define Xk+i = Xi for consistency. 

In the following, we study five different regimes depending on the parameter a (again, 
defined for this model as a = log(INR)/log(SNR), and propose upper bounds and feedback 
coding schemes for each one. We analyze the performance of the proposed schemes, and 
derive a symmetric achievable rate for them. In the rest of this section, we use bold symbols 
to denote blocks of length T, e.g.. 



The encoding schemes that we propose for each regime involve message splitting and rate- 
power allocation to the resulting sub-messages. Whenever we use SNR or INR to determine a 
power allocation, we inherently assume that SNR > 1 and INR > 1, e.g., we allocate \/ ^cmd^ 



of the power to some part of the message, which is meaningful only if SNR is larger than 1. 
However, if this assumption does not hold, we can still use the same coding schemes with 
max(l,SNR) and max(l, INR) instead of SNR and INR respectively, which leads to similar 
results. However, we exclude such cases for the sake of brevity. 



Yk = VsmXk + VmRXk+1 + 



k, 



k^l,2,...,K, 



(65) 



= {XkiU - i)T + 1), {XkiU - l)r + 2), . . . , {XkijT)) . 
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We state our upper bounds in terms of following expressions: 

A 4 1 log (^1 + SNR + INR + 2VSNR • INr) (66) 

B = ^\og(l + SNR + 2INR + INR^ + 2VSNR • INr) (67) 

C4llog(l + SNR+INR) (68) 

D ^ ^log(l + SNR) (69) 

E^\\oz{\^mC). (70) 

6.1 Very Weak Interference: < a < 1/2 
6.1.1 Coding Scheme 

The encoding scheme we propose here takes K blocks, each of length T. We assume each 
user k has a total of {2K + 1) messages, namely 

that it wishes to send to its respective receiver over K transmission blocks. Moreover, we 
set the size of these message sets with rates given by 



log|Mf)| 

n 


= R,= 




logl^i-''"^^! 

n 


= R2 = 




n 


-i?3 = 


^log 



V 3 

SNR 

" ' ' , k = l,...,K, j = l,...,K, (71) 



bNK I -1 
INR 



INR + 1 
/INR + 1 



, k = l,...,K, j = l,...,K. 



The messages are encoded using individual Gaussian codebooks with unit average power, to 
obtain 

f (h) iK,m) (1,1) (K,l)\ 

The signal transmitted by user k in block k is formed as 



/INR- 1 /SNR-INR^ /INR 

^^I^] = V "iN^^^-'^f^] + V SNR -INR ^^'-t^J + V SNR^^^'^f^^' 

where Xfc^^jj] = s^"''™-' and yik,i = ^k''^^- -'-^ ^^^^^ block, we have Xfc^/i[l] = s^''-*. For 
subsequent blocks, the high power part of the signal consists of the high power codeword 
of the neighboring transmitter sent over the last block, that is Xfc /j[7] = ^k+i,h[j ~ !]• 
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course, this is only possible if transmitter k can decode Xk+i,h[j — 1] from yfe[j — 1] received 
over the feedback link. 



Decoding the feedback signal at encoder Upon receiving yjk[j — 1] , the decoder removes 
its own signal to obtain 



yk[j-i]-Vsm^k[j-i] 

= \/lNRxfc+i[7--l]+Zfe[j-l] 



/— , , /SNR-INR2 , ^ /|NR2 r n r n 

VINR - Ixfe+i,/,^- - 1] + \/ ^ Xfc+i,^^- - 1] + y sNr'''^+'''^-^' ~ ~ 

(72) 

It then decodes ^k+i,h[j ~ 1]; up to rate 

1 , /INR+ 1\ 

Decoding process at the receiver At the receiver node k, it has to decode :sik,h[j] and 
^k,m[j]- This is done using a sequential decode-and-remove scheme, which can support rates 
that satisfy 

1, /SNR+INR + 1, 

^1 < - log -^Ki^ — 74 

- 2 ^ \^§M + |NR + 1 ' ^ ^ 

The receiver also stores the remaining part of its received signal. 



/SNR-INR^ /|NR2 

Ykb] = viNRxfc,i[j] + viNR - i^k+i,hb] + y — gj^ip — ^k+i,mb] + y ^j^x^+i^j] + Zk[j], 

(76) 

for further processing. In the next block, upon decoding + 1], it can use it to remove a 

part of the interference in yk\j]- Recall that Xfc /i[j + 1] = ^k+i,h[j]- Therefore, by removing 
from yfe[j], it can decode x^^;!;/], provided that its rate satisfies 

..a.o.(^). 



20 



The total achievable rate would be 

Ri + KR2 + KR3 

Rsym — ^ (78) 

1-^. (SO) 

6.1.2 Upper Bound 

In this regime, we use the following upper bound from Theorem H] on the feedback sum- 
capacity: 

Cm g(^) < max \h{Y,) + h{Y2\X,, ¥,) + ... + h{YK\X,, Y,, . . . , Xk-i, Yk-i) 

p{xi,...,xk) L 

-h{Y,,...,YK\X,,...,XK)]. (81) 

We first note the following: 

h{Yi) < ^ log (^1 + SNR + INR + 2VSNR ■ INr) + c (82) 

= A + c, (83) 

where c = 1/2 log(27re). 

For 2 < A; < (i^ - 1), we have 

h{Y,\X,, Fi, . . . , n_i) < h{Yk\Xk-u n_i) (84) 



= h{VSmXk + VINRXfe+i + ZklVmRXk + Zk-uX^-i) (85) 

< h{VsmXk + V\mXk+i + Zk\V\mXk + Zk^i) (86) 

1 / l + SNR + 2INR + INR^ + 2VSNR- INR\ , , 

^i'"^ j^' ' ' 

= B-E + c. (88) 

Similarly, we have 

h{YK\X,, n, . . . , Xk-i, Yk-i) < ^YkIX,, Y,,Xk-u Yk-i) (89) 



< h{VsmXK + Zk I VINRXa' + Zk-i) (90) 

1, /1 + SNR + INR\ 

<oiog — r—^ — +c (91) 



2 "V 1 + INR 

C-E + c. (92) 
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Finally, we have 



h(Yi, . . . , Yk\Xi, . . . , Xk) — h{Zi, . . . , Z^) 

= Kc. 



Hence, from flHTl). we have 



Cr„.,G(^) <A+iK-2)iB~E) + C-E 

= K{B -E) + {A + C + E- 2B), 



which implies that 



Cm ,g(^) <{B-E) + 



<{B-E) + 



E 
K' 



where we have used the fact that 



A<B 
C < B, 



which implies that {A + C -2B) <0. 
We also note that 



2B = log(l + SNR + 2INR + INR^ + 2VSNR- INR) 
< log(l + 6SNR) 
<log(6) + log(l + SNR) 
= log(6) + 2D. 



Collecting all the bounds, we have 



Cm,G(^) <{B-E) 



E 
K 



- ^ ' K 2 



Hence, the symmetric feedback capacity satisfies 



^ < C^y^,G{K) < 



iD-E) + ^ 



+ 
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so that the gap is given as 



2' 

and the degrees of freedom are given as 



^Jo^^K^ (109) 
<5 + ^ (110) 
< I (111) 



DoF™(a,ir) = (l-a) + -^, < a < 1/2. (112) 

6.2 Weak Interference: 1/2 < a < 2/3 
6.2.1 Coding Scheme 

In this regime we have SNR^^^ < INR < SNR^'^^. The encoding scheme for this regime takes 
benefit of the feedback hnk. We create a cycle of length K consisting of all the interfering 
and feedback hnks. A part of the message of each user is conveyed through this cycle. 

The encoding scheme is performed over K block. Assume each user has 2K+1 messages, 
namely 

The rates of the messages are given by 



n 2 ^V2(1 + INR)3 

The kth transmitter encodes its message using a individual Gaussian codebook with unit 
average power, to obtain 

(Jhh) JK,h) (m) (1,0 {K,l}\ 

The transmitting signal in block k is formed as 



;INR2-SNR /SNR- INR , jl , 

^fcb] - V — — ^fe-z^b] + y — ^ — ^k,mb] + Y inr""^''^]' 

where Xfe^/j[j] = s^^''^'* and Xk,i\j] — The moderate power codeword transmitted during 
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the first block is the codeword corresponding to M^™-*. However, in the next blocks, x^ ^ 
would be the moderate power codeword of the neighbor sent during the past block. More 
precisely, 

Xfc,m[j] = Xfc+i,„[j - 1] = XA;+2,m[j - 2] = ■ ■ ■ = Xfc+j_i,m[l] = s[™^._-^. 

Note that Xfc+i^m[j — 1] has to be decoded from the signal sent to the transmitter k over the 
feedback link at the end of block (j — 1). 

Decoding the feedback signal at encoder The signal received at receiver k in block j 
is forwarded to its respective transmitter at the end of the block. The transmitter will use 
it for forming its transmitting signal in the next block. The transmitter k removes the part 
of the signal sent by it to obtain 



yk[j] - VSNRxfc[j] = VlNRxfe+i[j] + z,[j] 



INR^-SNR /SNR - INR 

11^1^ — ^k+iAj\ + Y — ii^jR — ^k+i,m[J\ + ^k+iAj] + ^kbl- 

(114) 

The transmitter needs the moderate power codeword for the next transmission. In order to 
decode Xfc+i^m[j], it first decodes and removes the high power codeword, and then decodes 
the moderate power one. This can be done provided 

ft<il°gf^| (115) 




(116) 

It is easy to check that the rates in (I113p satisfy both constraints. 



Decoding process at the receiver The decoding procedure at decoder k is as follows. 
Upon receiving 



;SNR„„ n /SNR~T~r ~T~ /INR^-SNR 

y^j] = \/ - SNR)xfe,,[j] + y j^(SNR - INR)xfc,„[j] + W — x,+i,,[j] 



/SNR ^, /SNR-INR ^, , 

^ V TnR ^'^■''^"'^ ^ V INR + ^k+iAj] + mk] (117) 

it decodes :s.k,h[j], ^k,m[j], and ^k+i,h sequentially; that is in each step it treats everything 
else as noise, decodes the codeword, and removes the corresponding part from the received 
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signal. This can be done as long as 



1 /SNR+INR + 1 , , , 

2 Hl?S + 'NR + l 
R^<L log ^ (119) 

which are all satisfied with the rates in f lllSp . The remaining part of the signal would be 



/SNR /SNR-INR rn r,n / x 

= V Tnr ^^''^-^'^ ^ V INR + x^'+i'^^b'] + ZfeF], (121) 

which will be stored for further processing and for decoding x^t later. In the next block, 
once Xfc^mb + 1] is decoded, the decoder again recalls yfc[j] and subtracts from it the part 
corresponding to Xfc „j[j + 1] = '^k-v\,m\3\ Therefore, it obtains 



/SNR-INR /SNR rn r,n / x 

yfcbJ - Y Xfc+i,„[jJ = y "ii^xfc^jj + Xfe+i,,[j] + Zfc[A;], (122) 

from which Xfc i[j] can be decoded as long as 

i?3<^logf^^j, (123) 

which clearly holds with i?3 in f lllSp . Therefore, in each block, the receiver can decode the 
low power codeword of the previous block after removing the moderate power interfering 
signal. However, this process does not have to continue for ever, since in the i^-th block, 
the moderate power interfering signal at receiver k would be 

^k+\,m\K\ = Xfc+2,m[-f^ — 1] = ■ ■ ■ = Xfc+A-,rrt[l] = XA:,m[l], 

which was already decoded in the first block. 
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In summary, the total rate can be achieved per user per block would be 

KRi + R2 + KRs 



R. 



sym 



K 

^log(INR + l)-l + l/?2 

1 , /(1 + SNR)2 
E-\ log — ■ — 

K 2K 



- 1 



(124) 
(125) 
(126) 

(127) 



6.2.2 Upper Bound 



In this regime, we use the same upper bound as in the case of very weak interference regime. 
In particular, from fl96p . we have 



C'syld^) <{B-E) + 



{A + C + E-2B) 
K 



< 1 + ^ + 



< 1 + ^ + 



(A + C + E-iE) 
K 

(1 + D + 1/2 + D + E-AE) 



K 

^ (2D - 3E) 3 

E+- + 1 + . 

K 2K 



(128) 
(129) 
(130) 
(131) 



Here, in f ll30p . we have used the fact that for the weak interference regime, we have 2E < 
S < 1 + 2E, A < 1 + D, and C < 1/2 + D. Therefore, we have 



E + 



{2D - 3E) 
K 



1 
2K 



E + 



{2D - 3E) 
K 



+ 1 + 



2K' 



(132) 



which implies that the gap is bounded as follows: 



A < 2 + 



K 



(133) 



which is at most 3 bits per user-pair and we have 



DoF™(«, K)=a + 1/2 <« < 2/3. 

K 



(134) 



6.3 Moderate Interference: 2/3 < a < 1 
6.3.1 Coding Scheme 

In this regime we use the private and common message for the encoding scheme. Assume 
each transmitter has two messages, namely the high power (common) message Mf \ and 
the low power (private) message Mj!\ The following transmission scheme aims to convey 
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the common message Mj^^^ to both receivers k and k + 1. However, the private message Mj^'-* 
can be decoded only by the respective receiver. 

We assume that the high power messages of all users have the same rate. Similarly, the 
rate of the low power messages for all users are the same, that is 

loglA^l^^l 



n 

^^^log^^ ;t = l,...,i^. (135) 



n 



The encoder first maps its messages to Gaussian codewords with unit average power, x^^/j 
and Xfc^;, and sends 

/iNR- 1 n~ 

The receiver node k, upon receiving y^, with 

yfe[j] = VSNRxfe[j] + VmRxk+i\j] + Zk[j] (136) 



^(iNR - i)^k,h[j] + V\m-i^k+i,h\j] + y^'^kM + ^k+i,i[j] + ^k[j], 

(137) 

first jointly decodes the codewords x.\!^l and x^'^-,^ ^ treating all the rest as noise. Here we 
deal with a multiple access channel, whose achievable rate is characterized by 

^i<2log(m^l' (138) 

1 /|NR+SNR + i\ 
^i<2^»g(^ gNR72 j' ^^^^^ 

1 /SNR+INR + l\ , , 

In particular, it is easy to show that 

^ 1 /SNR + INR + 1, 

^i = 4^°s( I (^^^) 

satisfies the above constraints. After decoding the high power codewords, and removing 
them from the received signal, receiver k decodes its own low power message by treating the 
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other private codeword as noise. This private message can be rehably decoded provided that 



2 

which yields in an achievable total rate of 



1 /SNR + 2' 

^2<ilogP^|, (142) 



-Rsym — -Rl + -R2 (143) 

= 1 log (SNR + INR + 1) + i log (^2 + - i (144) 

> ^ log(l + SNR) - ^ log(l + INR) - ^ (145) 

(146) 

6.3.2 Upper Bound 

In this regime, we will develop a different upper bound that is analogous to the type-I upper 
bound obtained for the linear deterministic channel model. We have the following bound on 
the feedback sum capacity: 

OG(^)<f(^ + ^-^)- (147) 

The proof of fll47p is given in the appendix. Hence, (11471) implies that the symmetric feedback 
capacity is upper bounded as 



= — - 2 ■ 



Note that in this regime, we have 



2A = log(l + SNR + INR + 2VSNR ■ INR) (150) 

<log(l + 4SNR) (151) 

< log(4) + log(l + SNR) (152) 

= 2 + 2D, (153) 
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and similarly, 



2C = log(l + SNR + INR) 

< log(l + 2SNR) 

< log(2) + log(l + SNR) 
= 1 + 2/}, 



(154) 
(155) 
(156) 
(157) 



which implies that 




(158) 



Hence, we have 



2 



3 



(159) 



so that the gap between the upper and lower bounds is at most 5/4 bits and we have 



6.4 Strong Interference: 1 < a < 2 
6.4.1 Coding Scheme 

In this regime, we have SNR < INR < SNR^. The encoding scheme for this interference 
regime is simple, and the desired degrees of freedom can be achieved in one block. Denote 
the message of user k by G A^^, where all the message sets have the same size which 
results in a symmetric rate of R. Each user takes a random Gaussian codebook with rate 
R and unit average power. Then it randomly maps its message to and sends over the 
channel. The k-th receiver observes through a multiple access channel from the fc-th and 
{k + l)-th transmitters, in which it has to decode both messages. The achievable rate of the 
MAC is well-known as pT] 



DoF™(a,/s:) = 1 



a 



2/3 < a < 1. 



(160) 



2 



i?< -log(SNR + l), 
i?<ilog(INR + l), 
2R< - log (INR + SNR + 1). 



(163) 



(161) 



(162) 
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Hence, it is clear that by choosing 

i?sym = ^log(l + INR + SNR) (164) 
= f , (165) 
all constraints are satisfied and a symmetric rate of -Rgym is therefore achievable. 

6.4.2 Upper bound 

For this regime, we use the same upper bound developed in the previous section: 



Cm,G(^) < (166) 



Therefore, the symmetric feedback capacity satisfies 



C , , C A E 



< Cm,G(^) < o + (167) 



and the gap between the bounds is 



A-E , , 

A = (168) 



log(l + SNR + INR + 2VSNR ■ INR) - log(l + INR) , , 

= ^ (169) 

^ log(l+4INR)-log(l + INR) ^^^^^ 

^ log(4)+log(l + INR)-log(l + INR) ^^^^^ 



Moreover, from (11671) . it is straightforward to show that 



DoF™(a, ^) = |, 1 < tt < 2. (173) 

6.5 Very-Strong Interference: a > 2 
6.5.1 Coding Scheme 

The encoding scheme we propose here takes K blocks, each of length T. We assume each 
user k has a total of + 1 messages, namely (mI\m^^'^\ uf'^^^, that it wishes to 

send to its respective receiver over K transmission blocks. We assume that M'i^ G Mf and 
m\?'^'^ e Mf^\ where >l's are the message sets. Moreover, we set the size of these message 
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sets so that 



(174) 



That is, all the first messages of all the users have the same rate. Furthermore, the rates of all 
the remaining messages are also identical. Each message is encoded by a capacity achieving 
Gaussian codebook with unit variance. Hence user k has got K -\- 1 Gaussian codewords, 
4'^ 4^'^^^ . . . , s[f'''*\ each of length n. 

The signal sent by transmitter k in block j is composed of two parts, the high power part 
Xfe,,,[j] and low power Xjfc,/[j]: 



In all blocks, the high power part is the codeword corresponding to a fresh message. In the 
first block, since the nodes have not yet received any feedback, their low power codewords 
also describe a fresh message. However, for all blocks j > 2, the low level codeword used to 
form the transmitting signal is the low level codeword of their neighbor sent on the previous 
block. We will show that it can be decoded from the signal received over the feedback link 
at the end of the last block. More precisely, 

^kAj] = 4''"^ A; = 1, 2, . . . , J = 1, 2, . . . , i^, (176) 
^k,i[l] = 4\ k = l,2,...,K, (177) 
^k,i[j] = Xfe+i,ib - 1], A; = 1, 2, . . . , i^, J = 2, 3, . . . , i^. (178) 

Therefore we have the following recursive relationship between the low power codewords: 

^kM = ^k+iAj - 1] = ^k+2,i\j - 2] = • • • = Xfe+j_i,,[l] = si'|^_i, (179) 

where all the user and block indicators are modulo K, e.g., Xfe+j_i[l] = x.(^k+j-i) mod 



Decoding the feedback signal at encoder As stated above, in order to form the trans- 
mitting signal in block j, transmitter k uses the low power codeword sent by user /c + 1 in 
block j — 1. We first show that this codeword can be decoded based on the signal it receives 
over the feedback link at the end of block j — 1. 
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Once Ykii — 1] is received, transmitter k first removes its own signal, Xfc[j — 1], to obtain 



yk[3 - 1] - v^Xfc[j - 1] = ^INRxfc+i[j - 1] + z^j - 1] (180) 



^(SNR - l)x,+i,,[j - 1] + ^ sNr'''+'''^^ - 1] + z,[j - 1], 

(181) 

from which it has to decode both ^k+i,h[3 — 1] and x,t+i^;[j — 1]. It first decodes ^k+i,h[3 — 1], 
treating everything else as noise. Then, it removes ^k+i,h[3 — 1] from the signal and decodes 
Xfc+i,z[j — 1] in a similar manner. This is possible as long as 

1 /iNR + A , , 

which are clearly satisfied by the rates chosen in fll74p . Therefore, the transmitter k has 
access to ii.k+i,i[i " -'■l' which will be used as its low power codeword for block j. 

Decoding process at the receiver The signal sent by user k over the j-th block is given 
by 



which results in 



yk[3] = VSNRxfc[j] + VlNRx,.+i[j] + Zfc[j] (185) 



INR . _ /INR 



(SNR - l)xfc+i,4j] + \ -^^k+iAj] + VSNR- lxfc,4j] + ^kAj] + Zfcb]- 



SNR' . -^x,'H./j Y 5l^p 

(186) 

At the end of the j-th block, user k sequentially decodes the codewords :>Ck+i,h[j], ^k+i,i[3]^ 
and X/; At each step, it decodes the corresponding codewords, treating all the remaining 
parts as noise. Once one codeword is decoded, it removes it from its received signal, and 



32 



proceeds with the next codeword. This can be done provided that 



1 /SNR + 1\ , , 

i?2 < 2 log j ■ (189) 

It is easy to check that all constraints are satisfied by the choice of Ri and R2 in fll74p . 

At the end of each block, each receiver can decode its respective high power codeword, as 
well as some high power and low power codewords from other users which it is not intended 
to decode. However, from (11791) . the low power codeword decoded at receiver k at the very 
last block would be 

(*) (l^ 

Xfc+l,z[i^] = - 1] = ■ ■ ■ = Xfc+;^,;[1] = Xfc^Jl] = S^^ 

where (*) holds since k + K = k mod K. Therefore all the intended messages for receiver 
k, can be decoded using this scheme in K blocks. The total rate of communication would be 



R1 + KR2 1, , 1 , / NR \ irog3+l , , 

^svm = = - log SNR + 1 + log ^ + 1 ^ 190 

1 / INR \ inog3 + 1 , , 

= D + log ^ + 1 ^ 191 

1 , / 1 + INR \ inog3 + l , , 

.n,^^-i!^^l±». (193) 

6.5.2 Upper Bound 

For this regime we use the following upper bound from Theorem IH similar to the LD case: 
Cjld^) < max \h{YK) + h{YK^i\XK, Yk) + . . . + h{Yi\X2, Y^, . . . , Xk, Yk) 

p{xi,...,xk) L 

-/i(Fi,...,y^|Xi,...,Xx)]. (194) 
We upper bound the first term in (I194p as 

KYk) < ^ log (1 + SNR + INR + 2VSNR ■ INr) + c (195) 

= A + c, (196) 
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where c = (1/2) log(27re). 

For any 2 < k < {K — 1), we bound 



h(Yk\Xk^i, Ffc+i, • • • , ^K, Yr) < h(Yk\Xk^i) (197) 



= h{VsmXk + Zk\Xk+i) (198) 

< h{VsmXk + Zk) (199) 

< ^log(l + SNR) + c (200) 
= D + c. (201) 

Finally, we bound the penultimate term in f ll94p as follows: 

h{Y, 1X2, F2, . . . , Xk, Yk) < h{Y^\X2, F2, Xk, Yk) (202) 

= h{VsmX^ + Zr\X2,Y2,XK.YK) (203) 



< /i(ySNRXi + Zi I v^Xi + Zk) (204) 

1 /1 + SNR + INR\ , , 

< - log + c (205) 



2 °V 1 + INR 

C - E + c, (206) 



where in (l204ll . we used the fact that = vSNRX^- + ViNRXi + Zk and the fact that 
conditioning reduces differential entropy. Finally, we note that 

/i(yi, . . . , r^lXi, ...,Xk) = h{Zi, Zk\Xi, ...,Xk) (207) 

= h{Z,,...,ZK) (208) 

K 

= J2 ^(^^0 (209) 

k=l 

= Kc. (210) 
Hence, the feedback sum capacity is upper bounded as follows 

C™ ,g(^) <A + {K-2)D + C^E, (211) 
which implies that the symmetric feedback capacity satisfies 

<^^.o(K)<D^^A±£^^. (212, 
We now simplify this upper bound to compare it with the lower bound obtained in f ll93p . 
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We note that 



and 



2A = log(l + SNR + INR + 2VSNR ■ INR) (213) 

<log(l + 4INR) (214) 

< log(4) + log(l + INR) (215) 

= 2 + 2E, (216) 



2C = log(l + SNR + INR) (217) 

<log(l + 2INR) (218) 

< log(2) +log(l + INR) (219) 

= 1 + 2E, (220) 

which together imply that 

A + C -2D - E < (3/2) + 2E -2D - E (221) 

= {E-2D) + 3/2. (222) 

Hence, from (11931) and (12121) . the symmetric feedback capacity satisfies 



(E - 2D) {K\og{3) + l) ^^pB .r^^^ n , iE-2D) , 3 
^ ^ ^---o(^) <D + + — 



which imphes that the gap is given as 

S ^ (225) 

which is at most 2-bits. We note here that the gap of 2-bits can be reduced further to 
1-bit by modifying the power allocation in our coding scheme. The resulting gap analysis is 
however complicated and is not pursued here. 
Moreover, from (12231) . we have 

DoF™(a, K) = l + a> 2. (226) 

K 

7 Conclusions 

In this paper, we have considered the i^-user cyclic Z-interference channel with noiseless 
feedback. The symmetric feedback capacity of the linear deterministic CZIC has been com- 
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pletely characterized for all interference regimes. Using insights from the linear model, the 
symmetric feedback capacity for the Gaussian CZIC has been characterized within a con- 
stant number of bits for all interference regimes. As a consequence of the constant bit gap 
result, the symmetric feedback degrees of freedom for the Gaussian CZIC has also been char- 
acterized. It has been shown that the capacity gain obtained via feedback decreases as the 
number of users increases. The resuhing DoF™(a, K) for K > 2 users is a skewed l^- curve, 
as a function of the interference parameter a. Moreover as K ^ oo, the resulting skewed 
V^-curve converges to the well known W-cmve corresponding to the no-feedback DoF. 

As a part of future work, we plan to characterize the approximate feedback capacity 
region of the K-nsei Gaussian CZIC. We believe that new coding schemes and novel upper 
bounds would be required to achieve this goal. 



8 Appendix 

8.1 Proof of Theorem S] 

We show that the normalized symmetric feedback capacity is upper bounded as follows: 



To prove (12271) . we first prove the following upper bound on the sum of the rates of users 1 
and 2: 



where fl229p follows from the fact that the messages (Wi, . . . , Wk) are all mutually indepen- 
dent, fl230p follows from Fano's inequality [11], (123 ip follows from the deterministic nature 
of the channel model and (12331) follows from the fact that conditioning reduces entropy. 
Before proving (I235p we first prove the following claim: 

Claim 1 (Xit, X^t, ■ ■ ■ , Xxt) is as deterministic function of (V/^^, Wi, W3, . . . , Wk)- 




(227) 



T(i?i + R2) 
= H{Wi) + H{W2) 

= H{Wi\Ws, ...,Wk) + H{W2\Wi, 1^3, ... , Wk) 

< I{W,; Y.^lWs, ...,Wk) + I{W2; , Y^\W^, 1^3, ... , Wk) + ct 
= I{Wv, Y^\W^, ...,Wk) + H{Y^, Y^\W^, 1^3, ... , Wk) + er 

= H{Yl\W:,, ...,Wk) + H{Y^\Y^, 1^1, 1^3, ... , Wk) + er 

< H{Y^) + H{Y:[\Y^, Wi, PF3, . . . , Wk) + ct 

< Tmax(m, n) + H{Y:[\yI , Wi, W^, . . . , Wk) + ct 

< T max(m, n) + T{n — m)^ + e^. 



(228) 
(229) 
(230) 
(231) 
(232) 
(233) 
(234) 
(235) 
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Proof: First note that from (|3]), we have 

Xn = fu{W^,Yl-'), (236) 

and 

XKt = fKtiWK,Yj,-') (237) 
= fKt{WK,Xl-\X'K'), (238) 

which together imply that 

{Xu,XKt,Xl-\X'^') = f {W^,Wk,YI-') . (239) 

Repeating this argument for k = K — 1, . . . ,3, the proof of the claim is straightforward. ■ 
We now bound the second term in (12341) as follows: 

T 

H{Y^\Y^, VTi, W^,...,Wk)<Y, H{Y2t\Yu, W,, W^, . . . , Wk, F/"') (240) 

t=i 

T 

= ^ H{Y,t\Y,t, Xu, W,, X,t, Ws,..., Xku Wk, Y^-') (241) 
t=i 

T 

<J2H{Y2t\Yu,Xu,X,t) (242) 

t=i 

T 

<Y,H{X2t\Y,t,Xu,X3t) (243) 
t=i 

< T{n - m) + , (244) 

where (1241 p follows from Claim [1] and (I244p follows from the fact that {Xit^Yu) completely 
determine at least m levels of X2t- This completes the proof of ( ]235p . Dividing (I235P by nT 
and taking the limit T — > oo, we have er — > 0, which yields 

R1 + R2 fm \ vtlX^ 

< max — ,1 + 1 (245) 



n \n J \ n ^ 

= max(a, 1) + (1 - a)+ (246) 
= max (2 - a,a). (247) 



In a similar manner it can be shown that for any 1 < j < K, 

+ ^(j+i)m.od{K) 



n 



< max (2 - a, a) . (248) 
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Adding all such K upper bounds, we obtain 



2{R^ + ... + Rk) 



< K max (2 — a, a) , 



(249) 



n 



and hence, 



.FB 

sym,: 



,ld(",^) < max 1 



a a 



2' 2 



) 



(250) 



This upper bound on the normalized symmetric feedback capacity is independent of K and 
is the same as the normalized symmetric capacity without feedback when a e [2/3, 2]. Hence, 
for this interference regime, feedback does not increase the symmetric capacity. Also note 
that the range of a in deriving these bounds is immaterial and hence from a symmetric 
feedback capacity point of view, the feedback capacity ior K — 2 users always serves as an 
upper bound for any K > 2. 
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8.2 Proof of Theorem H 



For a permutation order n = (tti, 7r2, . . . , hk) for the K users, we have the following upper 
bound on the sum-rate: 



K 



K 



k=l 
K 

k=l 
K 



k=l 
K 

E 

k=l 



H{YJ^,...,YJJW^ 
-H{Yj^,...,Yj\W^,,...,W^,_,,W,) 



+ ex 



K 



EHiY'^VY'^ Y^ W W " 



k=l 

T 
t=l 



H{Yl,...X^W^..---.WK) + eT 



K 



+ eT 



< T max 

p{xi,...,xk) 



k=l 

H{Yit, . . . , Y/^flXit, . . . , Xxt) 

K 
fc=l 

H(Yi, . . . ,Yk\Xi, . . . ^Xk) + ct, 



(251) 
(252) 
(253) 



(254) 



(255) 



(256) 



(257) 



where fl252p follows from the independence of the messages, fl253p follows from Fano's in- 
equality lUj, and (12551) follows from the fact that the negative term corresponding to 



the fcth bracket is cancelled by a part of the positive term in the {k + l)th bracket, for 
/c = 1, . . . , {K — 1). Finally, dividing fl257p by T and letting T — )■ oo, we have the proof of 
Theorem |H 
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8.3 Proof of (HAn 



We first obtain a bound on the sum of the rates of users 1 and 2: 
T{Ri + R2) 

= H{Wi) + H{W2) (258) 
= H{Wi\Ws, ...,Wk) + H{W2\W,, 1^3, ... , Wk) (259) 

< I{Wi; Y^, Zi,...,Z]^\Ws,..., Wk) + 1^, if, Y,^ , Zj , . . . , Zj^\W,,W3, . . . , Wk) + er 

(260) 

= hiY,^, Zl...,Z],\Ws,..., Wk) + KY^\Y^, Z^ , . . . , Z^, W,, 1^3, ... , Wk) 

- h{Y^, Y^, Zl, ...,Z]^\W,,W2,Ws..., Wk) + er (261) 
= h{Y,^, Zi,...,Zj^\Ws,..., Wk) + h{Y,^\Y,^, Zj , Zf„ W,, W^, . . . , Wk) 

T 

- h{y2t, Y^t, Z,t, ZKt\Wu W2,W,..., Wk, Yt\ F/"', Zt\ Z'^') + (262) 
t=i 

= h{Y^, Zi,...,Zl\W5,..., Wk) + h{Y,^\Y,^, Zj, . . . , Z^, W,, W^, . . . , Wk) 

T 

, Z^t, . . . , ZKt\Xit., X2t, X^t, • • • , Xki) + er (263) 

i=l 

= h{Y,^, Zi,...,Zj^\W,,..., Wk) + h{Y,^\Y,^, Zj, . . . , Z^, W,, W,, . . . , Wk) 

T 

- h{Zit, Z2U Zzu . . . , ZKt) + er (264) 
t=i 

< h{Y^, Zl, ...,Zl)^ KY^\Y^, Zl, ...,Zl, W,, 1^3, ... , Wk) 

T 

- ^ h{Zxf, Z2U Zst, ZKt) + gt (265) 
t=i 

< h{Y^) + h{Zl, ...,Zl) + h{Y^\Y^, Zl, ...,Zl, W,, 1^3, ... , Wk) 

T 

- Y HZu, Z2t, Zst, . . . , ZKt) + er (266) 
t=i 

T 

<TA + Yh{Z3t,...,ZKt) + h{Y^^\Y,^,Zi,...,Zj^,W^,Ws,...,WK) 

t=i 

T 

- Y f'iZu, Z2t, Zst, . . . , ZKt) + er (267) 
t=i 

T T 

<TA + Y h{y2t\Xu, Yxu X3O - Y ^(^2*) + er (268) 
t=\ t=i 

T T 

= + + ^ /i(ySNRX2i + Z2t\Xu, yiNRXsi + Zu, X^t) - ^ h{Z2t) + er (269) 



t=\ t=\ 
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<TA + J2 HVsmx2t + Z2t\VmRX2t + z^) - J2 ^(^2t) + ct (270) 
t=i t=i 

<TA + T{C -E) + eT (271) 
= T{A + C-E) + er, (272) 

where fl259p follows from the independence of the messages, fl260p follows from Fano's in- 
equality, (12621) follows from the chain rule, and (I263p follows from the following argument: 

Xit is a function of (Wi, Y^'^) 

X2t is a function of iW2, Y^'-^), 

Xxt is a function of {Wk,XI~'^, Z^k^), 

X(^K-i)t is a function of {Wk, X^j^^ , Z^j^\), 

(273) 

X^t is a function of {W^, X*~\ Z*"^^ 



Xst is a function of (W^jX^ 



4 7) 
4 5^3 J- 



This argument allows us to write (Xi^, X2ti • • • , X^t) in the conditioning in the last term in 
(I263p and then use the memoryless property of the channel to arrive at (I264p . 

The same argument also allows us to write (Yi^, X^, Xsf) in the conditioning of the 
third term in fl268p and subsequently drop all the remaining random variables from the 
conditioning. We remark here that this argument is similar to Claim [1] used in the proof of 
Theorem [3] for the linear deterministic model. 

Finally, normalizing (I272p by T and taking the limit T — )■ oo, so that — )■ 0, we have 

Ri + R2< A + C - E. (274) 
In a similar manner, it can be shown that for any 1 < j < -ft', we have 

Rj + <A + C-E. (275) 

Adding all such K bounds, we obtain 

2{R^ + ... + Rk)<K{A + C -E), (276) 

which yields 

C!LdK)<^{A + C-E). (277) 
Hence, we have proved the analogue of the type-I upper bound for the K-user Gaussian 
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CZIC. 
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